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\ Cre;ai^ive 'Leari^ing through .the Application of 

So?:iological 'PrincipJ.es (CLapP) is a nontfadit ional program designed 
to help students develop their own concepts / theories /. and sfcilis ' 




twilderness ; 

^problem solving'^upon return to^'campus; (U) eigh-th week: midterm 
evaluat'ion; (5) ninth-twelfth weeks:' skilled experiences; (6) 
thirteenth-fourteenth weeks: reporting^ sharin.g^ ^ di^cussing^ an.4 
analyz-tng-f — d )^ fifteenth- sixteenth weeks: evalua^tion and^grading. 
A group of- students who had^'c^mpireted— t-w o ovaluc ttixm -pHases of^ an 
outdoor survival program and two different CLAJ5F groups all Involved 
in wilderness educational programs^ . were examined together with two 
control groups. The control groups were, a conventional beginning 
class in sop.iology ind a conventional T-*gtoup.' Result s' significantl y 
favor CLASP comiDunities over T-groups and control groups in terms of 
sociological content, changes" in self conception^ and acgidemic 
achievements. Strong 't)ositive re^c^ions ' r^ted the CLASP program as 
the best learning ^experience in the students' college career. The 
prog.ram has created considerable ''noise" in the traditional academic 
system for nont-r^ditional education. Recommendation^ are made- for - 
institutions to "ada^pt this survival-type program to the needs of each 
college department. (Author/BJG) 



i 



^bocumenta acquired by ERIC include many inform^ unpublished materiaU not available from other lourcef. ERIC niaitei every 
effort Jto obtain the best copy available. Nevertheless, items of marginal reproducibility are often encountered and this affects the 
Q of the microfiche and hardcopy reproductions ERIC makes available \/ia the ERlC Document Reproduction Service (EDRS>. 
j^l^^is not responsible for the quality of the original document. I^eprodutjtions supplied by EDRS are the best that can be made fiom 



t 1 

o 



EVALUATION OF ONE TY-PE OF 'NON-TRADITIONAL 
PROGRAM OF* HIGHER EDUCATION 



CrS OEPAPTMENT OF HEALTH 
EDUCATION A WELFARE 
NATIONAL INSTITUTE OF 
EDUCATION 

JL' \r » PO N^' Of V € A 0» OPINIONS 
w*A*E;:^ NOT NE^FSOAOi^v QEPOE 
' NA'-ONAL NS^iTi^TfOf 
FO A T r)»< PO' •'ONOOPOl"'^ 



by 



L. [La Mar Adams, Lel^nd H. Campbell, 
Institutional Research > 
R^y Alvord, Academic Standards, 
and John Seggar, Department of Sociology 
Brigham Young University 

Provo, Utah 84602. 
(801 ) 374-12'n, Ext. '4242 * 



7 



V; 



o o 



Paper presented at the AERA Convention in ^Washington, D.C., April 2, 1975 



2 



EVALUATION "OF QNE TYPE OF NON-TRADITIONAL PROGRAM IN HIGME'R EDUCATION 

/ 

Boocock (1972, pp, 151, 311 )" observed' that the conventional structure of 
' n)odern education is not conducive to learning processes. University ^tudents 
and instructors have experienced a growing awareness that the modern curri- 
culum tends to be a straight-jacket which retards student and faculty develop- 
ment (Staley, -^1969). Tesconi (1972, p. 157) argued t.hat the "homofenization 
imperativ^" of a factory system of education "trivializes man, (and), leads to 
impersonal-ity in the school..." 

One product'of the discontent in thg modern system of education is the • 

rapidly growing use of wil derness-typg cufr)jcula to' provide remedies for prob-* 

lems found in modern educational programs. Several wilderness-type programs 

presently exist on various campuses iji the nation, as evident in Shuff and 

Shuff (1972) and Barcus and Bergeson (1972). Wilderness-type programs have 

been used to^help in the development of self-actualization, zeal, and other 

attributes of students.* Attributes of zeal, motivation, determination, self- 

actualization, and so forth, have been considered to be major determinants of 

academic'success in higher education. The Monthly Newsletter by the Royal Bank 

of Canada (1974) stated: ' , ' ' . 

« 

Charles Darwin held the opinion as the result of a lifetime -of 
critical observation that men differ less in 'capacity than in 
zeal and determination to utilize the .powers they have. 

* Educators have tjieorized that attributes of self-concept can. improve the 
academic success of students in most campus departments and colleges. Research 
is needed to determine ,the extent to'^ which theLwilderness-type program can be 



0 ' 

adapted to the various departments and the extent to which these attributes of 
self-concept inl'luence academic success. 

4 

Use of Wilderness-Type Programs. 

.One of the major problems in using non-traditional programs in hi-gher edu- 
cation is evaluating their success. The appropriate research methodology to be 
used«is determined by the goals of the educatipna) program, just as the' statis- 
tical analysis depends upon the* research question involved.- Evaluation resulting 
from vari,ous types of non-traditionat)l program have been somewhat equivocal be- 
^cause of their evaluation methodologies. Foulds (1971), Clifford (1967), and 
Adams (19.69) rep-orted- significant changes in sel f-cancept. The changes, however, 
varied from study to study. Treppa and Fricke (1972) and the counseling. center 
staff of the University of Massaitiusetts (1972) reported -no significant differ- 
,ences in measured outcomes for group experiences. 

Variations between results of various studies are attributable to varia- 
tions in the purposes of the studies. Grossman (1967) and Maynard (1969) used 
wilderness training programs to help juvenile delinquents. A number of programs 

havfe been used to improve the academic performance of potential "drop out" stu- 

« 

dents, as reported by Berry (1966), Lingo (1966), and Moses and. Peterson (1970). 

Barcus anS Bergeson (1972) and Stimpson and Pedersen (1970) Emphasized the 
need to determine the permanence of self-concept changes resulting from wilder- 
ness training programs. -Previous studies *have lacked the longitudinal research 
to examine, permanency. Another methodological problem in most of the previous 
studies is lack of a control group. Barcus and Bergeson (1972) stated in re- 
view that "only'one study (f^oses and Pedersen, 1970) used a comparison with a 
'control group." Other problems found In previous studies include extremely 



small sample sizes"* and prpblems of statistical procedures such as the use of 
multiple t-tests. . * ^ . 

Research Objectives. 

.The present study, was desigrted to avoid the problems found in previous 
studies. The research purpose was four-fold.- The first purpose was to eval- 
uate the accomplishments in terms of the objectives of the non-traditional pro- 
grams in higher education; second, to evaluate the achievement of participants 
and their reactions to the program; third, to ascertain the adaptability of 
such programs to various on-campus departments .in institutions of higffer edu- 
cation; and fourth, to provide appropriate recommendations to administrative 
officers of the university as to the relative contribution of the program to 
the university. 

Methodology. > i \ ' 

I 

The group of students who had completed two evaluation phases of an out- 
door survival program and two different CLASP (Creative Learning through the 
Application of Sociological Principles) groups, all involved in 'wilderness- » 
.type education?! programs, were examined together with two control groups. The 
control groups were a conventional, on-carapus beginning class in sociology and 
a conventional on-campus T-group. A total of 201 students were examined in the 
analysis: 21 students who had completed the two outdoor, survival-group phases, 
61 in the two CLASP groups, 86 in the sociology control group, and 33 students , 
in the .on-campus T-group. There were two concurrent CLASP groups taught by two 
different instructors: 30 students in CLASP I and 31 in CLASP II. Since the 
groups were of necessity intact classes, robustness of statistical analysis re- 
ferred to by Stigler (1973, pp. 872-879) was assumed for the analysis. 



yiutdoor Survival > Students in ttie survival group registered for Youth 
Leadership 480 (Outdoor Survival) at Brigham Young University, Summer and Fall 
semesters of 1971. The survival experience is a fivfi-phase program following 
an initial two-day campus instructional activity. The five phases of the 
thirty-day program, are entitled Impact, Group Expedition, Survival, Small 
Group Expedition, and Solo. The Impact phase consists of three days of total 

* V 

v^or large group acti^vities which include a..forty-mile h-ike and living off the 
land. In tHe Group Expedition phase, ^separate^ifeje -and female groups encounter 
a 70-80 mile hike and are involved in mutual goal seul^w and cooperative prob- 
lem solving. In the^vSurvi val phase, the entire large group satisfy their total 
needs entirely off the land for a six-day period. * In t|ie Small Group "Expedition," 
four to five students taQkle cross-country problems for four to five days in an . 
80-mile hike. In the Solo, phase, students^are in a four to five day wilderness 
isolation situation. The survival experience program is based on the conviction 

that more is learned through active participation than'through passive accdp- 

^ ^ \ 

tance. Learning activities are specifically designed to* develop greater self- 

' . . . \ 

actua nzatton. ' - . 
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Adaptations . Adaptations of .wilderness progr^ims to objectives of various 
departments on campus are examined according to the goals of the departments. 
Examples of the adaptation of wilderness programs to campus departments include; 
the use of wilderness experiences in the sociological CLASP program and th^ use 
of outdoor survival experiences in readmitting students to the university who 
have been suspended on .academic failure. 

The CLASP program was devised as a "sociology semester" (Sundeen-, 1972) 
and was establ isRecI'^'to help the student develop his own concepts, theories, and 
skills. The prografn for each semester fs formulated according to the needs of 
the students. One of the paramount elements of this type of non-traditional 



education is the use of non-sfructured curricula. The student is placed in an 

environment^ where -he or she tests out* relationships of his own emerging goals 

♦ 

with th'ose of other students and facuTty. I.p^^tudent decision-making, the stu- 
dent is given increasing responsibilities for self-direction throughout the 
semester. 

Ihja program consists of seven phases: 1) first week: testing, simulating, 
and preparation; 2)- second- thtrth-weeks: human relations and* survival lab in 
wilderness (elements of outdoor survival adapted to sociological principles^, 
theories, and techniques); 3) fourth-seventh weeks: post-wilderness community 
problem solving upon return to campus; 4) eighth week: midterm evaluation;* 
5) ninth-twelfth weeks: skilled experiences; 6). tfiirt^enth-fourteenth wee.ks: 
reporting, sharing, discussing, and analyzing; and 7) fifteenth-sixteenth 
weeks: evaluation and grading. 

Students included in the readmissiori adaptation' analysis were those sus- 
pended from Jhe up'iversiiy for academic failure. The suspended students v^ere 
readmitted through one of four different voluntarily selected programs. The* 
four available programs for readmission are: first, college work at another 
institution of higher education with a specified minimum grade point average 
(GPA); second, completion of specified correspondence courses with a minimum 
GPA; third, acceptance by a readmission committee jn response to a special 
request of the student based on particularlevid^ce of acadepiic capability; 
.and fourth, satisfactory completion of the -outdoor survival training class 
(Youth Leadership 480). Sample sizes of the four groups examined in this phase 
of the study were 102 students in the College Work group, 58 students in' Corres- 
pondence, 37 in Survival Program, and 74 in Committee Decision. Success of the 
survival progranrin preparing suspended students foV readmission was measured* 



ERLC 



in terms of mean GPA and percent of students successfully completing their first 
semester after readmission! 

Evaluation meas>jres were administered to students to provide a basis for 
statistical analyses ofi student changes in mental health, sociological content 
knowledge, and overall conception, of the program. Mental health or self-actual- 
ization was measured jjsirvg the Tennessee Self-Concept Scale and the Personal 
Orientation Inventory (POI), Although other types of self-concept measures haye 
been used by some researchers (Clifford and Clifford, 1967; Stimpson and 
Pedersen, 1970; Treppa and Fricke, 1972), the Tennessee Scale and the POI have 
apparently had mo/e widespread -usage (Heaps and Thorstenson, 1973, 1974; Barcus 
and Bergeson, 1972; and McClain, 1970). In addition to its use in identifying 
self-concept (Foulds, 1971; Fox, 1968; and Knapp, 1965), POI has been used by 
therapists as a diagnostic instrument to measure a patient's current level of 
positive mental health or self-actualization (Shostrom, 1964). It has been 
reported that the POI differentiates between groups oY subjects designated by 
"Clinicians as representing different categories of self-actualization (McClain, 
1970; Shostrom, 1966; and Fox, Knapp, and Michael, 1968). 

The Tennessee Scale and'the POI were each administered in the form of pre- 
ahd post- tests to various survival, CLASP, and control groups. The form used 
for the Tennessee Scale specifies 17 attribute classifications: physical selfr 
moral and ethical, behavior, self-satisfaction, identity, self-criticism, per- 
sonality integration, social self, family self, personal self,*^total positive, 
neuroticism, personality disorder, general ma>adjustment, defensive positive, 
number deviant signs, and psychotic. 

Sociological content knowledge was measured by pre- and post-forms of 
final examinations. The final examination forms were constructed by Individual 

8 
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Learning Systems, Inc. (ILS) and were designed for beginning courses in socio- 
logy '{Kinch^, 1971). The ILS forms were administered to both CLASP groups and 
lo a control group. ^ ' ' . - • 

Students' overall attitudes towards the program were analyzed using "follow 
up quesaj7ionnaires. The questionnaires asked the students to compare the CLASP 
program with the best other semester of their university life in relation to: ♦ 
fir^t, learning acquired; second, personal growth, and third, the "excitement" 
about learning. ^ - ^ . 

' Multi-Dimensional Evaluation . Snow (1974) Suggests that there is a com- 
pendium of outcomes from any educational experience. Unexpected outcomes may 
result from new learning methods in unfamiliar surroundings involving undis- 
covered principles. Non-traditional methodology and outcomes suggest a need 
for a multi-dimensional research model. In considering a miil ti-dimenbional 
model for evaluating wiTderness-type programs, one dimension shown in Figure 1 
is the "Context for Skilled Performance" in terms of size of the group being 
evaluated, whether individual, small group, or large samples. A second dimen- 
sion adds other attributes to be analyzed. Five sociological attributes' listed 
in Figure 1 are intellectual, social, emotional, spiritual, and physical. There 
remains yet a third dimension, that of needs and objectives. In th.e educational 
setting for wilderness-type educational programs, objectives includ^ Personal 
Need Fulfillment, Program Objectives, and Institutional Certificatipn. Adding 
the third dimension to the two-dimensional model provides a more complete ap- 
proach to eva,luation and illustrates the complexity of the problem. 

Evaluation for the complex multi-dimensional model requires continuation 
of present research f'or longitudinal analysis in addition to exteViding the 
dimensions of existing research. Wkults of present research may be considered 

9 
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to be onlyiDreliminary in light of the multi-dimensional model of research. 

Preliminary Results , . , ' , / 

•Statistical and descriptive analyses reflect significant attribute changes 
for the wilderness-type groups over those of the control groups. A certain 
amount of mental health improvement was ?found to be unique to the outdoor sur- 
vival group^. Some of the results from the CLASP group were consistent with 
those from the survival group and others were different. Consistencies and 
de.iaiions between results of the two programs can be expected since the CLASP 
program adapted only^certain wilderness-type^TTements from the survival program 
Only the attributes in the Tennessee Self-Concept Senile which were signifi- 
cant for at least one of the groups examined were included in Table 1. Six of 
the attribute changes identified in the immediate results were also observable 
in the one-year results for the survival group: physical self, moral and ethi- 
cal, behavior, self-satisfaction, identity, and personal self. Three of thesfi 
same attributes were also common to the results 'for both CLASP groups: behavior--, 
social self, and personal self. No significant change on the Tennessee Scale 
was found for either the T-gjcoup or the^conventional class. All of, the attri- 
butes. listed in Table 1 were significant for .CLASP I. The differences between 
the significant results for CLASP I and CLASP II can be explained in terms of 
different instructors for the group and individual differences be^een the two 
"groups. ' 0 . 

The results in Table 1 indicate a degree of permanency for certain attri- 
bute changes for the siVvival group. Certain attribute changes also appear to 
be common to each of th^ wilderness-type programs, but not to the control 
groups. Finally, certain additional attributes are unique to *the CLASP group 
contrasted to the survival and control groups. 



11 



10 ' 



O 
U 

4J 

c 
o o 



(l4 



04 

CO 
CJ 



> 



> CO 

> -o 
o 

CO 
M 



o 




GO 

a; 
u 
o 

GO 

O 

0) ^ 

o 

^3 0) 

C > 
CO ^ 

I ^ 
OJ CO 

^ s 

*> CO 



o 

d 
V 



o 
u 
u 

CO 

^ o 

^ c 

CO xj 

^ a 
o 5 

a 

•H a; 

•H CO 

c a 

to C/3 
CO 4J 

a; 

o a 
c 

c o 

■H >, 

a iH 

0) 

CO 



60 
C 
< CO 



CO CO 
0) (0 



0) OJ 

^ Q) 
O X 
^ 4J 

u 

o 



> 

CO 
60 
0) 
C 



ERLC 



12 



^ SignffiGatit changes, for students irt- both 'CLASP groups wer^ identified foir 

five 0f the -attributes in the Tennessee SeVf -Concept Scale listed in Table 1. 

/ ^hree o^ th^ attribute changes unique to b'oth CLASP groups are improvemeats- in 

• /'/ * - -y* ^* • ' ' ^ * 
ni^uroticism, personality disorders, and generSl maladjustment.- There was also 

. ' ' - • . ^ V ' • ' • . • , 

a sigmficarrt increase between pre- and post- tests for defensiv.e^posit^ ve/ 
- ^ ' ' ' - . / * *^ * ♦ ^ , ' \ ^ 

Results of ^tj^POI t6st in measuring mental health or sel f-act-ual izatioji 

*** confirm the.resu-Us from the Tenn^^ssee^^Sel f-ConCept Scale ir\ that none ''of the; 

^ .''scales shewed significant changes for tji^control groups, 6ut five were sig- 

. , nificant for both CLASP groups • ^ " ^ - . 

Sociqlogica/I Content Knowledge. , ^ ^ ^ . 

^The res^lts^of the ajialysis on sociological content' knowledge for the ' , 

CLASP groups were^ listed in Table 2. ^oth £LASP groups had a sigaifidant Mn- 

• • • ■* ^ . ' ' 

crease 'in the amount of sociologica] content knowTedge for the CLASP**seniester 

• * * ■> 

The control* g^^up, a conventional' on-campus beginiing course in sociology, had 

; , no .si.gaificant increase between scor^^on the^pr*- and post-farms of the ILS 

-final;e:)^m1nation tests> The* results ind4cat^ thVt the CLASP program affected 
\ signi/icdht changes in the' students ' sociological content knowledge as measured 
thesis exdini nation forms, - ' ' * • 

^- " ^l^dmission^ol* Suspended Students. ^ ^m. ^ - ' , 

^ . 'V,^*4*^^Q'^t&*f^^ were given their choice a/tiong four methods of 

. qualifying^!? readmiss.ion: academic work at another institutiorTof high^ edu.- 

. cation, c(\rresp|ndence work at Br.igham- Young University, successful, completion 
> ••^ ^ • 

• of the survival TDro^r am, oY comnittee action* on appear. 

/ - Although the me.an GPA was highest for the ^"Survival " group and lowest for^ 

^^be* "Comipittee" group, the GPA's for'bpth first semester (GPA - 2.45 and 2.15 
* • • «* 



TABLE 2 

Sociological Content Knowledge of CLASP- and Control Groups 
as'Measured by Pre- and Po5t=Tests' 
Fall Semester -1973 ' 

4? • 







Pre 


-test 


, Post-test 




Group 


N 


X 


S 


X 


S 

0 


Change 


CLs/^SP I 


31 


61.6 


1:4 


69.7 


1 .5 


+8.1 sig.2 


CLASP II 


.30 


■. 6*. 3 


•1 .'5 • 


71.0 


1.7 


+6.7 sig. 


Control • 


85 


53.6 


2.0 


54.8 

& 


2-9^ 


' +1.2 n.. s . ' 



"'lests^: Individual Learning Systems, Inc., Final Exam A. and Final 
Exam B/ ' (1st ed.) ' " , ' 3^ - 

2p <0.05 " . ' . ' 



■ • \ 

V 

/ J' 

' . . . .'^ ■14 , 



respectively) and cumulative (2.10 and 1.7J3 respectively) were not significantly 
•different. The fact that there was no significant difference in mean GPA among 
the four groups indicates that the four methods used for readmission were equally 
successful as measured by mean. GPA., The percent of students per group who ob- 
t'ained a /iiean GPA acceptable^ for their first semester after readmission is also 
listed in Table 3. There was no significant difference among the fouV groups 
in the percent of those who were successful after readmission to the university. 
Since ^there was no significant difference among the four groups, the survived 
prbgram wagr^ considered to *be successful in*qual ifyin^g student^s for readmission 
to the university. The academic success of students in the survival program 
was especially noteworthy since the program was basically non-academic. The 
survival program,. in addiction, was only 30 days^ in duration compared to a full 
16*-week semester of^ academic work for the Academic Work and .Correspondence 
Work groups,^ If a student does not have the necessary Credentials to be ad~ 
'mitted by committee action on appeal, readmission through participation* in the 
survival program could be highly recommended. 

Non-Traditiorlal Evaluation. - ^ . ' 

> ♦ 

Traditional evalua'tion seldom considered feelings and attitudes left upon 

the students by their experience in the program.* Descriptive arjalyses'were, 

'therefore, made of the overall impact of the program on student participants. 
■ . ' - • ' ^'Ji 

Respon^ses were recorded to questions 'v/Hich asked participants in the CLAS^. pro- 

gram to make various comparisons of their^ CLASP semester with their best other 
semester^. The results from this descriptive analysis follow. Approximately 
89.7^^ of the .participants rated their^ CLASP 'semester as the best overall semes- 
ter in their college career. Only 6.9% rated CLASP equal to^ the best other 
semester,-and 3.4% rated CLASP ' below their best semester. In addition, 96.6% 
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rated CLASP as'their best semester for "excitement"* about learning. The follow- 
ing excerpts are typical responses from students in wilderness-type programs. 
Male Studefit: 

/' « 
The contrast between my first semester and CLASP is overwhelming. 
It was like going from darkness into light... This semester I spent 
hours in the library going down the shelves, reading whatever looked- 
interesting. . .doing and learning because I was interested and 'wanted 
to. 

\ . ' . 

Female Student: 

I would spend two or three hours writing in my journal...! read 
ten books completely and started three others...! never worked so 
hard and jpent so much time in terms of reading^ Never before did 
(sic) ! spend from seven in the morning 'til nine at night in the 
librarj/ . 

Students in general indicated that wilderness-type programs greatly con- 
tributed to their u'niversity life and rated the programs as the b"B^t; experience 
of their entire college career. * • ^ • 

Preliminary Conclusions. . 7 

The results of "the analysis thus far conducted indicate that speo^^ic mea- 
surab^le accomplishments have been made by students in ,the'various wilderness- 
typ£ programs. Students in wilderness-type programs improved in mental health 
more than students in the traditional courses as measured by two evaluation 
' instruments rlationally used in therapeutic fields. Students in. a wilderness- 
type socfological program excelled in sociological content knowledge as mea- 
sured by !LS final examirjations in contrast to students in the traditional 
sociology course at the university. Another accomplishment in the use of wil- 
derness-type programs was the preparing of students for successful readmission 
who had been suspended from the university for academic failure. 
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Participant react|a||^ft the program were found to be positive. Partici- 

pants also rated the program as the best experience in their university life. 
♦ 

The success of adapting wildernesS-type programs to seme on-campus departments 

also indicates that successful adaptation can be expected for other departments 
ft 

and colleges. Adaptation and extent of use would, of course, vary according to 
the given department and correspond-ing objectives. 

A negative aspect of wil derness^type programs is the risk of physical 
casualty. Although some groups have reported that no fatalities and few or no 
accidents have occurre3, some have t^en reported with other groups. A negative 
-result of the CLASP program also appears to be in the area of "defensive posi- 
tive" on the Tennessee Self-Concept Scale. Further research is suggested for 
'this attribute to determine if negative change is desirable. If the cha-nge is' 
found to be undesirable, further research would then be needed to determine how 
the progran) could be changed to produce more desirable results. 

The results from the data analyzed confirm results <from previous studies in 
that significant improvements were found in attributes of mental health for stu- 
dents in general and in grade point average for underachievers. Significant 
changes in attribute^ of mental health reported in the present study differ from 
those reported in previous studies. The particular attributes found to change 
significantly depended upon the particular wilderness-type program examined and 
oa the individual instructors or administrators of the program. 

Challenges for Future Evaluation. 

It was discovered in th^- eval uation that additional rese^irch is needed to 
more completely define objectives of the programs and the techniques for eval- 
uating their success. l|he statistical procedures used in evaluating a program 
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depeoiJ upon the objecti-ves of the program. Existing tests are often used when, 
it would be more appropriate to first structure the r^esearch approach to eval- 
uate the program and then construct appropriate tests and* measures accordingly. 

One of the major problems in evaluating wilderness-type' programs in higher 
education is isolating the phases of the program which contribute to a givea 
change in the student's attitude and behavior. It has been difficult to ran- 
domly assigr> the students to a given program' or phase of the program since one 
of the major purposes of the program, is /to encoura:ge freedom in decision making. 
The groups analyze<t to- dette have consisted of intact groups resulting fromv 
voluntary selection. Further researcl/ is needed, however, to isolate the effec- 
tive elements in the program. 

Another challenge for the research is to identify the parameters of the 
various cells in the multi-dimensional evaluation model for wilderness-type 
educational progf^ms. Research -is needed to identify and measure possible un- 
known influences of the multi-p^ase program, Both immediate and longitudinal, 
in tfie lives of students. Another dimension of analysis is to examine the 
effects of motivation generated by the wilderness-type program on the students' 
academic success in general at the university. Further research is planned to 
analyze academic success of readmitted students who were suspended for academic 
*/a,ilure. Additional longitudinal analyses are also needed to ^determine the 
extent to which changes are retained by the students over a prolongecj period 
of years and to determine the extent to which the changes are desirable. 
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